INSTABILITY OF VORTEX SOLITONS FOR 2D 
FOCUSING NLS 



TETSU MIZUMACHI 

Abstract. We study instability of a vortex soliton e lCm9+ut) (?!> Uim (r) to 
iu t + Am + |u| p_1 u = 0, for x € R n , t > 0, 

where n = 2, m G N and (r, #) are polar coordinates in R 2 . Grillakis 
(11 j proved that every radially standing wave solutions are unstable if 
p > 1+4/n. However, we do not have any examples of unstable standing 
wave solutions in the subcritical case (p < 1 + n/4). 

Suppose 0o;,m is nonnegative. We investigate a limiting profile of 
4>ui,m as m — > oo and prove that for every p > 1, there exists an m* G 
N such that for m > m», a vortex soliton e l ( m9 +"') <f)^ m {r) becomes 
unstable to the perturbations of the form e l ' m+ -^%(r) with KjCm. 



1. Introduction 

In the present paper, we consider instability of radially symmetric vortex 
solitons to 2-dimensional nonlinear Schrodinger equations 

( iu t + Au + f(u) = for (x, t)el"x R, 

[ u(x,0) = uq(x) for x £ R 2 , 

where n = 2 and /(u) = |-u| p_1 u. Let to > 0, m £ N U {0}, and let 
e i{ut+mB) w ( r ) be a standing wave solution of Q belonging to ff 1 (M 2 ). Here 
r and 8 denote polar coordinates in R 2 . Then (f>u(r) is a solution to 

b" + -0' - fw + -j- j + = forr>0, 



(1) 



(2) 



lim^)=lim 



,0 r m r->® mr m ~ l ' 
lim (j){r) = 0. 

r— +oo 



We remark that e l <f> w (r) is a solution to the scalar field equation 

(3) Aip - ujip + f(ip) = forxeR 2 . 

A standing wave solution of the form e *M+ me ) ^ w (r) appears in the study 
of nonlinear optics (see references in [T£). If to = and (f>u)(r) is positive, 
then ^ is a ground state. Existence and uniqueness of the ground state are 
well known (see 0, [fi], |16| and reference therein). 

If m / 0, Iaia and Warchall proved the existence of smooth solutions 
to ((2j) with any prescribed number of zeroes. The uniqueness of positive 

Key words and phrases, nonlinear Schrodinger equation,standing wave solutions, lim- 
iting profile, orbital instability, large spinning number. 

This research is supported by Grant-in-Aid for Scientific Research (No. 17740079)). 

1 



2 



TETSU MIZUMACHI 



solutions has been proved by ^H] by using the classification theorem of 
positive solutions due to Yanagida and Yotsutani |29j . 
Let c > and let Q c be a positive solution to 

( Q" -cQ + f(Q) =0 for x G M, 



(4) 



Then 



lim Q(x) = 0, 
Q(0) = maxQ(x). 



i 



(5) Qc(x) = { ^Y\ xh ^(^z2hd x 



In |17j . Pego and Warchall numerically observe that as spin index m be- 
comes larger, a solution (j> u (r) to (J2J) remains small initially and then is 
approximated by Q c (r — f) around r = f, where c = lu + (m 2 /f 2 ) and f is a 
positive number with r = 0{m) as m — > oo (see also 121] and references in 
|17j). One of our goals in the present paper is to explain this phenomena. 
Benci and D'Aprile [3] studied Q in a general setting and locate the asymp- 
totic peak of solutions (see also Recently, Ambrosetti, Malchiodi and 
Ni [2j have proved the existence of positive radial solutions concentrating on 
spheres to a class of singularly perturbed problem 

e 2 Au-Vu+\u\ p ~ 1 u = 0, 

and obtain their asymptotic profile. Adopting the argument in [2], we obtain 
the following. 

Theorem 1. Let p > 1 and let 4> u . m be a positive solution to (J2J). Then 
there exists an m* G N such that if m > m* , 

(6) Uu>, m {-) ~ Qc(- - r)\\ H? m = 0(m- 1/2 ), 

(7) Il0w,m(-) - Qc(- ~ f)|| L oo (R2) = 0(m _1 ), 



where r = 2m/ W (p — l)u> and c = (p + 3)o;/4. 

Remark 1. Let r = ms, e = 1/m and V(r) = uj + r~ 2 . Then © is trans- 
formed into 

e 2 A r 0-y(r)0 + /(0) = 0. 

Though [2] assumes the boundedness of V(r) and cannot be applied directly 
to our problem, a maximum point of 4>uj, m ( r ) can be predicted from an 
auxiliary weighted potential rV(r) introduced by [2]. 

Let (fu be a ground state to ©• As is well known, the standing wave solu- 
tion e^ifu is stable if dWifuW^^n^/du) > and unstable if d\ \ip w \ \ 2 L2 ^ n ^/duj < 
0. See e.g. Berestycki-Cazenave 0], Cazenave-Lions j7j, Grillakis-Shatah- 
Strauss jT2] , ^Sl > Shatah [55] , Shatah-Strauss [21] and Weinstein |2H] • Namely, 
the standing wave solution e^ip^ is stable ifl < p < 1 + 4/re and unstable 
if P > 1 + 4/n. Grillakis jllj proved that every radially symmetric standing 
wave solution is linearly unstable if p > 1 + 4/n. However, to the best our 
knowledge, it remains unknown whether there exists an unstable standing 
wave solution with higher energy in the subcritical case (1 < p < 1 + 4/n). 
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Using Theorem ^ we find an unstable direction and prove e l ( ult + m9 ) (j) u (r) 
is unstable in H 1 (M?) if p > 1 and m is sufficiently large. 

Theorem 2. Let p > 1 and <fi W)m be as in Theorem Q Then there exists 
an m* G N such that if in > m*, a standing wave solution e l ( ujt + m9 ) ^ i s 
linearly unstable. 

Remark 2. By Shatah-Strauss Lemma (see |2,~>l I26| . see also 20 ), we have 
orbital instability of the linearly unstable standing wave solutions. 

Remark 3. If p < 1 + 4/n and uq G H 1 (W n ), a solution to (^Q) exists globally 
in time and remains bounded in i? 1 (R n ). Thus the mechanism of instability 
shown in Theorem|2]is quite different from that of [IJ where solutions around 
a standing wave solution blow up in finite time. The instability mechanism 
we find is close to transversal long-wave instability of 1-dimensional soli- 
ton (see Alexander-Pego- Sachs ^ for KP equation and Bridges jHJ |H] for 
nonlinear Schrodinger equation). Theorem ^ shows that a profile of vortex 
soliton is close to lD-soliton for large m and thus it becomes possible to find 
unstable modes by using perturbation method. 

Remark 4. If (p u m is nonneg ative, then e i( - md+ ^ <j> w (r) is a ground state in 
the class X m = {e im9 v(r) \ v G H^ ad (R 2 ), v G L 2 rad (R 2 )} and it follows from 
Grillakis et al. (^U) that the standing wave solution e l ( m6,+a; 'Vu;(0 is stable 
in the class X m if 1 < p < 3 (|18|). Thus the vortex soliton is stable to the 
symmetric perturbations in the subcritical case. 

Our plan of the present paper is as follows. In Section 2, we specify a 
solution to ((2j) which is expected to become close to a solution to (j3J) as m 
tends to infinity. In Section 3, we investigate some properties of the lin- 
earized operator around an approximate solution constructed is Section 2. 
In Section 4, we prove Theorem ^ following the lines of [2] and using Lia- 
punov Schmidt method. Since 11^(^)1^2(^2) grows up as m — > oo whereas 
II^ujMHl 00 remains bounded, we need to estimate both L^(IR 2 )-norm and 
L£°(]R 2 )-norm of the solution to obtain Theorem ^ In Section 5, we prove 
that e tm< y ujt + me ) ^ i s unstable to the perturbations of the form e^ m+ ^ 9 v(r) 
with \j\ ~ 77j, mm (p- 1 . 1 )/ 6 and obtain Theorem[21 

Finally, we introduce several notations. For Banach spaces X and Y, 
let B(X, Y) be the space of all bounded linear operators from X to Y 
and let H^H^x.Y) be the operator norm of an operator A: X — > Y. We 
abbreviate B(X,X) as B{X). We denote by D{A) and R(A) the do- 
main and the range of the operator A, respectively. We use notations 

\\fh m = Cn/WI'rdr)', \\f\\ Hm = (C(l/W + l/(0| 2 H^, 
A r = d 2 + r~ 1 d r and [ | «/* [ I .Sf 2 fM. 2 ) = 11(1 — ^r)/llL 2 (R 2 )- Various constants will 
be simply denoted by C and Cj (i G N) in the course of calculations. 

2. AN APPROXIMATION 

In this section, we will construct an approximate solution to © for large 
m. Suppose that a positive solution to © is approximated by Q c (r — f) 
around r = f for large m. Let «o = f/m, e = s = r — f and 
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v(s) = (j) u (r). Then (J2J) transforms into 
(8) 

v ss + -±-v. - ( w + (Qo ^ fl)2 ) - + /(«) =0 for , E (-f, oo) 
lim , V(S \ = lim Vsis) 



-r (s + r) m s— r m(s + r) m 1 ' 
lim u(s) = 0. 

» s— >oo 

Substituting v(s) = vq(s) + evi(s) + 0(e 2 ) into © and formally equating 
the power of e, we obtain 

f - cu + f(vo) = 0, 

(9) 
and 
(10) 



lim v Q (s) = 0, 



v" - cvi + f'(v Q )vi = -a 1 v' - 2a 3 sv , 



lim vi(s) = 0, 

I. s— >±oo 

where c = a; + Oq 2 . Let uo(s) = Q c (s), L c := d% — c + f'(Q c ) and D(L C ) = 
H 2 (H). Since ker(L c ) = span{Q£,}, the Fredholm alternative implies that 
lfTU|) has a solution v\ E L 2 (M) if and only if 

(11) / Q' c ( s ) ( Q' c (s) + ^Q c (s)) da = / ( Q' c (sf - \Qc(s?\ ds = 0. 

Lemma 3. Let c = u + ag 2 and let Q c be a solution to (jljl. // l)lljl holds, 
then c = (p + 3)cj/4 and qo = 2/y/(p— 

Proof. By (@J), 

2 / /n \p-i\ 



dx / " c V \ A 
where ^4 P_1 = (p + l)c/2. We compute 



4 







-2 v v/ , i (^y ',/« 



and 



A ' dx 



/oo /■/! 
Q c (x) 2 dx =2 / Q 2 
-oo j0 



dQ 

2 /" u 



dQ c 
^=du 

2.4 2 



(p-l)v^ 



Combining the above, we have c = (p + 3)w/4 and ao = 2/ yip — l)u>. □ 



X(r) 



711 
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Let x( s ) be smooth nonnegative functions on K satisfying < x( r ) — 1 
and 

' 1 if \r\ < 2, 
if \r\ > 3, 

and let Xi( s ) = x( s /0; where I = — max(l, log e. Following we 
put 

(12) *fap)(r)=xi(r-p)Q c (r-p), c = oj + (ep)- 2 , 

(13) <pcj,m = $(e,p)+ w, 

and search for a positive solution to © for large m. To fix the decomposition 
(fT3"|) . we assume 

(14) KW i?(BJ) = o. 

Substituting 1|12|) into (J2J), we obtain 

(15) £(e, p)u; + i?i(e, p, w) + i?2(e> p) = 0, 
where i? 2 = R21 + -R22 + -R23 and 

i*l =/($(£, p) + W) - f(<f>(s, p)) - /'($(£, 

i? 21 =/($(£, p))-r p ( X if(Q c )) 

( m 2 \ 1 

i?22 = (c-o;-^2-l $(e,p) + -Tp(xiVc) 

-R23 =t p (x"<2c + 2x;Q' c ) + ^r p (x{Q c ) • 

Here t/j denotes the translation, that is, (r^/)(x) = f(x — h). We will search 
a solution (p, w) to (fTi)) and lfT5|l with p G (o;o/(2e), 2ao/e) for large m G N. 

3. Spectrum of the linearized operator C(e, p) 

In this section, we examine spectral properties of the linearized operator 
C(e,p). To begin with, we recall some properties of the operator A r — to — 
m jr . 

Lemma 4. Let < e < 1/2 and C [s): L 2 (R 2 ) -> L 2 r (R 2 ) be a closed 
operator such that 

Co(e)u = A r u — uju — (er)~ 2 u 
for u G Co°(M + ). Then Co(e) is a self-adjoint operator with 

D{C Q {e)) = {u G H 2 (R 2 ) \ r~ 2 u G L 2 (R 2 )} and R{£ (e)) = L 2 r {R 2 ). 

Proof Let X = {H 2 (R 2 ) \ r~ 2 u G L 2 (R 2 )} be a Hilbert space equipped with 
the norm = (|M|^ 2{H , 2) + Wr^uf^^) 1 / 2 . 

By Theorem 10.10 and Example 4 in |22| Appendix to X.l], the operator 
Cq(s) is essentially self-adjoint in C^°(R + ). Thus for any u G D(Co(e)), 
there exist u n G Co°(R+) (n G N) such that Co{e)u n — > Cq{e)u and u n — > u 
in L 2 (R 2 ) as n — > 00. 



6 



TETSU MIZUMACHI 



Integrating by parts, we have 
(16) 

I|£o(£HIl2(k2) 

= || (w - A r )u;|||2( R 2) + 25ft ((w - A r )w, (er)~ 2 u;) L 2 (R2) + || OO^HIl^) 

>||(w - A T >||2 2(R2) + (e" 4 - 4 £ ~ 2 ) ||^ 2 w|| 2 2 (R2) 

for every w G Co°(M+). Eq. JTHJ) yields that {« n }£L 1 is a Cauchy sequence 
in X and u n — > it in X as n — > oo. Thus we have -D(£o( £ )) C X. 

Next we prove _D(£o(e)) ^ -X'- For every u £ X, there exist u n G Cq°(]R+) 
(n = 1, 2, • • • ) such that linin^oo ||-u n — u\\x = 0. Since 

\\£o{£)w\\LU« 2 ) ^ max ( 1 ^)ll w lli/ r 2 (K 2 ) + e ~ 2 H r ~ 2 ^llL2(R2), 

we see that {Co(e)u n }^ =1 and {n„}™ =1 are Cauchy sequences in L 2 (M 2 ) and 
that there exists a v G L 2 (M 2 ) such that £o(£)m„ — ► t> as n — ► oo. Since 
jCo(e) is closed, it follows that v = Cu and u G D(Co(e)). Thus we prove 
D(C (e)) =X. 

Finally, we will show that R(Cq(s)) = L 2 (IR 2 ). The self-adjointness of 
£o( e ) an d (|TH|l implies 

RiCoie)) 1 = ker(£ (e)) = {0}. 

Hence it follows that R(£ (e)) = L 2 (M 2 ) and that for every v G L 2 (M 2 ), 
there exist u n G X and t> n G L 2 (M 2 ) [n G N) such that 

£-o{£)u n = v n ^ v in L 2 (M 2 ) as n —* oo. 

By (|T6|) . there exists u £ X such that lim n _» 00 u n = u in X. Since £o(s0 is 
closed we have v = Co(e)u G R(Co(e)). This completes the proof of Lemma 

n □ 

Let V(s,p) and p) be orthogonal projections defined by 

V(e,p)u = \\d p <S>{e, p)\\l% (R2) (u, d p ${e, p)) L 2 {R2) d p <S>(e, p), 
Q(e,p)=I-V(e,p). 
We will show that C(e,p) is invertible on Q(e, p)L 2 (M 2 ). 
Lemma 5. Let w G ^(M 2 ) fl {u \ r~ 1 u G L^.(R 2 )} and 

(tw.Sp^fe.p))^^) = (i^Sfop)** - )^^) =0. 
Then there exist positive numbers e* and c% such that 

~{C{e, P)W,W) L 2 {M 2) > Cl 11^11^2(^2) 

for every e G (0, e* ) and p G (ao / (2e) , 2ao / e) . 

To prove Lemma |SJ we need the following. 
Lemma 6. Let p > 1, c > and Ao = (p — l)(p + 3)/4. T/ien 

£+1 £+1 

-^cQc 2 = AocQc 2 • 

Furthermore, ker(L c ) = {f3Q' c \ (3 G M} and i/iere exists a positive number b 
depending only on of p such that cr(L c ) \ {0, Aqc} C (— oo, —be]. 
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Proof. The former part of the lemma can be obtained by a simple com- 
putation. Let c = 1. Weyl's essential spectrum theorem tells us that the 
spectrum of L\ consists of essential spectrum (—00, — 1] and discrete eigen- 
values. Since Q± has exactly one zero and LiQ'i = 0, it follows from Strum's 
comparison theorem that is a second eigenvalue of L\ and that ker(Li) is 
spanned by Q[. Since L^u^^x)) = c(Liu)(c l l 2 x) for every u £ H 2 (R), 
we have o~(L c ) = {cA | A £ a(L\)}. Thus we prove Lemma|HI □ 

Proof of Lemma\^ Let Xo(s) = 1 — Xi( s ) an d Xi( s ) = Xi( s )- By © and the 
fact that suppxo C {r G M | \r\ > 21}, 

(C(e,p)w,w) L 2^ ={C(e,p)xiw,xiw) L 2 {R 2 ) + 2(£ (e)xow, X\w) L ^) 



+ (£ (e)xow, Xow) Lm2) + 0(e- 2{ P- l ^ d \\w\ 



Integrating by parts and substituting |xo( r )| + lx'i( r )l = ^0 ) the 
resulting equation, we have 



(17) 



and 



(18) 



(£o(z)xow,xow)l2(r2) 

/•oo 

/ ((Xo w )r + ( u + { £r Y 2 ){xow) 2 ) rdr 
Jo 

/•oo 

/ Xo (w 2 ~\~ low 2 + (er)~ 2 w 2 ) rdr + O^" 1 
JO 



{C-o{£)xow,xiw) L i{m?) 

DO 

X0X1 (w r 2 + uw 2 + (er)~ 2 u> 2 ) rdr + O^^IMI^i^)). 



Let U: L 2 (M. 2 ) — » L 2 (M + ) be the unitary operator defined by U<p(r) 

1 , , , 



r2(b(r). Then 



l-4e 



1 ^2 



T-pUCtfU- 1 =d 2 -co- - 4 + /'(xiQ c ) 

(a + er) z 

(19) /1 

where a = p/m and c = to + a~ 2 . Let xi an d X2 be smooth nonnegative 
functions on M. satisfying 

sup|Xi(r)| = 0{r l ) fori = 0,1, 

f if \r\ < I f 1 if |r| < 3/ 

^° (r) = \l if|r|>2/' ^ l(r) = \0 if|r|>4/- 

Put w(r) = (r + p) 1 / 2 xi(r)tf(r + p). Using w _L d p <fr(s,p) and 

(20) d p $(e,p) = -t p (xiQc)' ~ ^T p ( X id c Q c ), 
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we have 

=(w,9 p $(e,p)) L 2 (R 2 ) 

(xiQc)'(r)w(r + p)(r + p)dr + 0(e 1/2 \\w\\ L 2 



- / (p + r) 1 /2^Q' c(ir + o(( / , 1 /2 e -2^ +e l/2 )||u;||i?(R2) ^ 



Hence it follows that 

(21) (w,Q' c ) L 2 m = 0(eloge|H| L 2( R 2)). 
Similarly, we have 

p+i 

(22) (*,<2c 2 ) i2 (R2) = 0(e log £||w|| L 2( R2 )). 

Combining LemmaElwith (fT9]> . (|2Tj) and (|22]> . we see that there exist positive 
constants C\ and C2 such that 

(23) -(C{e,p)xiw,xiw) L 2 (R 2 ) > Ci\\w\\ 2 Hlm > C 2 ||xHI#;i( R 2)- 

Thus by (fT7|) . (|T8|) and (|23|) . there exist positive numbers c\ and such 
that 

-{C{e,p)w,w) L 2 r{R 2 ) > Cl 11^1^2(^2) 

for every e G (0, e*), p G (ao/(2e), 2a /e). □ 

LetXi = Q(e,p)X,Y 1 = Q(e, p)L 2 (M. 2 ) and A(e, p) = Q(s, p)C(e, p)Q(e, p). 
Lemma yields that A(e, p): X\ — » Fi is isomorphic. 

Corollary 7. There exist positive numbers and v such that 

(24) \\A{e,pY l u\\ x < HMU? (R2) 
for every u G Y\, e G (0, £*) and p G (ao/(2e),2ao/e). 
Proof. Let Qi and Q2 be orthogonal projections such that 

\\Q(s,p)$(e,p) 2 \\l m2) 

Q2 = Q{e,p)-Q 1 . 
Then A(e, p) can be written as 

A( £ p \ _ {Qi£>{z,P)Ql Q\C{e,p)Q 2 



y Q 2 C(e,p)Qi Q2£(£,p)Q2j' 
In view of Lemma El we see that there exists a c 2 > such that 

(£(e, p)Q(e, p)$(e, p) ~ , Q(e, p)$(e, p) ~ ) L 2 (M2) > c 2 || Q(e, p)$(e, p) ~ ||22 (R2) . 
Furthermore, we see that 

!™ (IIQi^(£,p)Q2||b(l2(r2)) + \\Q2C(e, p)Qi\\b(l^ 2 ))) = °- 
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Combining the above with Lemma |SJ we obtain 

(25) sup sup ||^(£,p) _1 ||b(lP(k 2 )) < °o. 

se(0,e«)pe(a /{2e),2ao/e) 

Let 

B(e, p) =V(e, P )C(e, p) + C(e, p)V(e, p) - V(e, p)C(e, p)V(e, p) - /'(*(e, p)). 
Then 

(26) Co(e)=A(e,p)+B(£,p). 
Using PH|). (|26|) and the fact that 

sup sup \\B(e,p)\\ B(L 2 (R2)) < oo, 

£e(0,e»)pe(ao/(2e),2a /e) 

we have 

(27) \\£ (e)A(e,p)- 1 u\\ L 2 ( ^2 ) < Cllull^^n) 

for every u G Yi, e G (0, e#) and p G (ao/(2e), 2ao/e). Combining (fl6|) and 
(J2H), we obtain (jSJ)- □ 

We will use the lemma below to estimate L°°-norm of w in the following 
section. 

Corollary 8. Let p > 1. TTien i/iere exist positive numbers and C such 
that 

(28) 11-4(^1 p) -1 «llL«oiia) < C|I u IIl-(r2) 

for everyu G L£°(IR 2 )nYi, e G (0,e*) withe^ 1 G N andp G (a /(2e), 2a /e). 

Proof. Let m = e _1 G N and 

p-L-u = u - II ( 3cIIl2( R )('u ) Qc)l 2 (k)Qc) 

£(e,p) = Q(e,p) {(t p xo)A(£) -1 (t p Xo) + ETVpXii^c ^Xi^-pl/} Q(e,p). 
Noting that e imd £o(e)u(r) = (A — Lo)(e ime u(r)), we have 

sup ||£o(£) _1 ||b(l^(]R2)) < oo- 

meN 

Furthermore, L c : P _L L 2 (1R) — > L 2 (M) has a bounded inverse. Hence it fol- 
lows that 

(29) sup sup ||/C(e,p)|| B(L oo( M 2)) < oo. 

m^e" 1 pe(ao/(2e),2a /e) 

We compute 

A(e, p)K(e, p) 

(30) =^(e,p)(r p xo)>Co(e)" 1 (TpXo) + A(e, p)IJ- 1 t p xiP ± L- 1 P ± Xi t_ p U. 
=1 + 77. 
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Since A(e,p) = A)( e ) — B{e,p) an d \\B(e, p)t p xo\\b(l°°) = 0(e~^ v ^ 1 ), where 
p = min(l,p — 1), we have 

(31) 

/ =Q(e, p)£ (e)(T p xo)£o(£y 1 (TpXo) ~ B(e, p)(r p xo)C (ey 1 (T p xo) 
= Q{e,p) (r p (xoXo) + [A r , r p Xo]£o( e )~ 1/r pXo - B(e, p)(T p xo)^o(e) _1 (-r p Xo)} 
^pXo + OCr 1 ) ini?(Q( e ,p)L^(IR 2 )). 

Let jBi =T(e,p)£(e,p)T(s,p) - £(e, p)V(e t p). Then 
„4(e,p) = Q{e,p)C(e,p)+Bi(e,p). 

In view of the definition of p), (|2*U)) and the fact that L C Q' C = 0, we have 

l|£lO>P)II.B(L~(R2)) = 

for e G (0,e*) and p G («o/(2e), 2ao/e). Furthermore (|Z5j) implies 

s (^>- p± IL,™. = °< E >- 



Let 

% = a -2 _ ( Q + £f )-2 + f( XlQc ) - /'(Q c ). 

Then we have £(e, p) = U~ 1 (t p L c )U + r p 7?, and 

||(r p ^i)(l-A r )- 1 |b (iO o (R2)) = 0(d + e^ 1 )^)- 
Combining the above, we have 

// =Q(e, p)XJ- x t p {P^L c )t p xxP^L~ x P^xiT- p U + 0(el) 

(32) =Q( £ ,p)T p (x lX i) + 0(r 1 ) 

=r„Xl + Oir 1 ) mB(Q(e,p)L?(M. 2 ). 
From <pn)l - (p^|) . we deduce (J2HD- □ 

4. The method of Liapunov-Schmidt 

In this section, we use the method of Liapunov-Schmidt to obtain a solu- 
tion to (JT1|) and (|15[). Let us translate lfTo|l into a system 

(33) ^(e,p)u; + Q(e,p)i? 1 (u;,e,p) + Q(e,p) J R 2 (e,p) =0, 

(34) P(e, p) (£(e, p)w + fl^w, e, p) + R 2 {e, p)) = 0. 

Lemma 9. Let p > 1. T/ien i/iere ezisi an eq > and a C > suc/i £/iai if 
£ G (0, £o] and p G (ao/(2e), 2oto/e), Eq. (|33() /ias a unique solution w(e,p) 
that is continuous in e and p and satisfies 

(35) \\w(e,p)\\ x <Ce* as e j 0. 

Proof. Let T: Xi x (0, eo] x ( a o/(2£), 2ao/e) — ► Xi be a continuous mapping 
defined by 

T(w, e, p) = -A(e, p)~ l Q{e, p) {Ri(w, e, p) + R 2 {e, p)} , 

and let X = {w G X\ | ||n>||x < ^o}i where ro is a positive number to be 
fixed later. 
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To begin with, we will show that T maps X into itself. We compute 



(36) 



\Ri\ 



{/(*(£, p)+0w) -/'(($(£, p))}d9w 



Ll 



<S(r ) ||^||i2 (R2), 

where 5(ro) is a positive constant with lim ro jo S(ro) = 0. Eq. © and the 
definition of xi imply 

\\Rn\\ L ^) = \\r P {(xT* - XOO?" 1 }!^^ 
<Cp 1 /2 e -2( P -i)^ ) 

and 

ll p ll <r r^V^-V^ 
Since = 0(e) and / = — -^=max(l, ^ry)loge, 

7 

(37) [1-^21 1 Up + 11-^23 |Up(R2) < Ci£2. 

Using © and a -2 — (a + es)~ 2 = %e + 0(e 2 s 2 ), we have 

,2" 



m 



C - U 5- Tn(xiQ'c 



Ll 



=e 
<Ce 



(a + es) 



31 



a 2 (a + es) 2 



Xi(s)Q' c (s) } ds 



for every a = ep 6 {cxq/2, 2oq). Similarly, we have 



: xiO' c 



< CV/ 2 . 



Ll 



Thus we obtain 

(38) ll-R22|Up( M 2) < C 2 e 1/2 . 
Combining (|36|) - (|38j) with Corollary we have 

(39) \\T(w,e, p)\\ x < v(5(r )\\w\\ x + C^/ 2 + C2E 1 / 2 ). 

Put r = 2^C 2 e 1/2 . Then T(-,e,p) maps X into itself if £o is sufficiently 
small. 

Next, we will show that T(-,e,p) is a contraction mapping. For u>i, w 2 6 

||T(wi,e,/o) - T(ui 2 ,e,/))|U 
<v[|-Ri(ioi,e-,/o) - Ri(w 2 ,e,p)\\ L 2r 



[ {/'($ + ffwi + (1 - 0)w 2 ) - /'($)} d9( Wl - w 2 ) 

Jo Ll 
<k\\w 2 ~ ^l|Up(K 2 ) 

where A = WqSup ^ ||/'(^+^)||cp andp = min(l,p— 1). Taking eo smaller 
if necessary, we see that T(-,e,p): X — > X is a contraction mapping. Thus 
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we prove that there exists a solution w(e,p) to (|3*3|) with \\w\\x < 2uC2£ 1 ^ 2 
that is continuous in e G (0,£o) and p S (ao/(2e),2ao/e). □ 

Corollary 10. Ze£ p > 1. Then there exist an £q > and a C > sitc/i 
that if e £ (0,£o)> e ^ N and p G (ao/(2e),2ao/e), a solution w(e,p) to 
satisfies 

(40) He,p)IU» <Ce. 

Proof. Analogously to (|3oT) -(|38 j) . we have 
||-Ri||l°° < 5(ro)||w||i«>, 

11-^2 IIl 2 (ir 2 ) — ||-R2i||l°° + H-R22IIX 00 + ||^23||l°° = O(e), 



where <5(ro) is a positive number with lim ro jo 8(tq) = 0. Thus by Corollary 
1 

||to(e,p)||L«. <C (||i?i||z,°° + ||-R2|U°°) 
<C5(r ) || +0(e). 

Thus we have (jUJ) □ 
Let 

F(e,p) = (C(e,p)w(e,p)+Ri(w(e,p),e,p) + R 2 (e, p),d p $(e, p)) L 2 {R2) . 
By Lemma El the system of (|33]l and (|34"|) is reduced to an equation 
(41) F(e,p) = 0. 

Lemma 11. Let p > 1 and let £0 > fe a sufficiently small number. If 
e £ (0, £q]; i/iere exists a p = p(£) E (ao/(2e),2ao/e) satisfying (|41|l. 



Proo/. Let ft c = ^<9 r + - + /'(xiQc) - /'(Q c ). Using ©, 

the definition of xi and the fact that L c Qc = an d p = we compute 



). r 3 



T>Xl]T>Q' c IU2( a 2) + ||r p (7i c (xiQ / c ))|| L 2 



[|£(e,pMxiQ' c )[| i a ( 

(42) ^IIW^cQ'Jl 2 ^ 2 ) + 
=0(£V 2 ). 

Similarly, we have 

\\£(£,p)(d p <S>(£,p)+T p ( X lQ' c ))\\LU^) 



(43) 

By Lemma El (jl^l and 

(44) K^^^a^^p))^ 

Lemma El and Corollary ^3 yield 



Li 



<Ce 1/2 \\ W \\ Ll 



C>(£). 



(45) 



I^iIIl 2 



< ch^ii^oo ii^Hl 2 



0(e 
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where p = min(p — 1,1). Combining (|37|) and (|45[) with 

||9 p $(e, /0 )|| L 2 (K2) =O(e- 1 / 2 ), 

we have 

(46) \(R 1 +R 21 + R23,d p $) L 2 m \=0(eP). 

In view of (jSHJ and the fact that \\d p <&(e,p) + t p (xiQ' c )\\l%(m?) = O^ 1 / 2 ), 

(47) (R 22 , d p $(e, p) + r p ( X iQ' c )) L 2 m = 0(e). 
By (011), glj) and g7|), 

F(e,p) = -(R 22 ,r p (xiQ' c )) LUm +0(en. 

Substituting 

— ^ - t — ttt = -|s + 0(e 2 s 2 ) as e j 0, 

or (a + es) z a 01 

and integrating by parts, we have 

(-R22,T p (xiQc))l2(R 2 ) 
1 Z" 00 / 1 1 \ 

Xi(s) 2 Qc(s)Q' c (s)(a + es)ds 



£ J-p \ a2 ( a + £s ) 2 

oo 

xi( S ) 2 Q' c ( 5 ) 2 d S 



= I" X? + ) + 0(e) 

= ^{q' c 2 -^Qc}^ + 0( £ ). 

Combining the above, we see that 

F(e,p)= I (Q' c ( s f-(ep)- 2 Q c (s) 2 )ds + 0(en, 



where c = u> + (ep) 2 . Hence it follows from Lemma Eland the intermediate 
value theorem that (|4"Tj) has a solution p = p(e) satisfying 

p = (a + o(l))e _1 as e j 0. 

Thus we complete the proof of Lemma 1111 □ 

Now, we are in position to prove Theorem ^ 

Proof of Theorem Q Lemmas EH and ^2 and Corollary E3 imply that there 
exists a solution c/> u to Q satisfying © and 0. Suppose that W is a 
sign-changing solution. Since > and ^ = at the minimum point, it 
follows from (j2j) that 

m.m(j) u (r) < -oj 1 ^ p ~ 1 \ 

r>0 

But this contracts to (jJJ) if e > is sufficiently small. Thus the solution ^ 
to (0) is nonnegative. Since a nonnegative solution is unique (see JB]), we 
obtain Theorem^ □ 
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5. Instability of vortex solitons 

In this section, we will prove Theorem[21 Let u(x, t) = e lujt {e imd (^^{r) + 
e xt v ) and linearize (^Q) around v = and t = 0. Then 

(48) iXv + (A - uj + #i(r))t; + e 2ime /3 2 (r)v = 0, 



where 

Put v = e l (i +m ' >e y+, v = ^~ m )^y_ and complexify l|48[) into a system 



A r - w - (m ^"/ )2 + iX + fr(r) ) y+ + fo(r)y- = 0, 
A r -u- ± ^- + A(r) ) y_ + (3 2 {r)y + = 0. 



(49) 



If A is an eigenvalue of the linearized operator, there exist a j € Z and a solu- 
tion (y+, y_) to (H that satisfy (e^ j+m ^y + (r), e^'-^VO)) G -fT 1 (IR 2 , C 2 ). 
We will show the existence of unstable eigenvalues for j with l<Cj€m. 

Let w\ = y + + y-, W2 = y+ — y~, £ = m _1 and (5 = je. Let s = r — aom. 
Then (|49|) can be rewritten as 

(50) H{e,5)w = Xw, 

where w = \w\, w^), 



(51) H(e,5)=i 
and 



h21 h-22 



hn 


= h 2 2 


h\2 


= A r 


h 2 i 


= A r 



-2m j 



,2 i -2 



„2 



We remark that 

T-fhll =T_f/l22 



-2(5 



(a + er) 



r_ f /ii2 =«9 2 H ^ <9 r - u - 1 + 5 + 0£ 1 

«o + («o + £r) z 

1 "I - (5"^ 

T-fhzi =<9 2 H ■ d r -uj- ■ + pc^" 1 . 

«o + er (ao + ery 

Before we investigate the spectrum of H(e, 5), let us consider the spectrum 
of a linear operator 

w \L + -a 2 J 2 -2a 2 <5, / 
where L + = d 2 s - c + pQl' 1 , L_ = 9?-c+QT\ £>(£+) = D(L-) = H 



2 1 



and c = uj + a 2 . 
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To begin with, we recall some spectral properties of H(0). Let 

and 
where 

0-2 = u o) ' 6,1 = 2 (d^"^ c "^ 2 ( R )) ' 6,2 = ^^"lW 

Then we have 

(52) F(o)$i = 0, ir (o)* 2 = *i, #(o)$ 3 = 0, ir (o)*4 = $ 3 , 

(53) £T(0)**; = *2, #(0)*$ 2 = 0, H(0)*<f>* 3 = $l, #(0)*$ 4 = 0, 

and = 5ij for i, j = 1,2,3,4. Here we denote by (•,•) the inner 

product of L 2 (M,C 2 ). 

Proposition 12 (see |27|). Let p > 1 anc? p 7^ 5. T/ien A = is a discrete 
eigenvalue of H(0) with algebraic multiplicity 4. 

Using Proposition 1121 we investigate the spectrum of H(5). 

Lemma 13. Let 1 < p < 5. Then there exist a positive number 5q and a 
neighborhood U C C o/O such that for every 5 £ (0, 5o), a(H(5))nU consists 
of algebraically simple eigenvalues \i(5) (i = 1,2,3,4) satisfying 

|3KAi(<y) - an VI < <*oV/4, liminf I 5" 1 min |A<(5) - A,-(5)| I > 0, 

5J.0 \ 1<M<4, ' 

\ 

where ^ 

/ ||Qc|| L 2( R ) \ 
7= 2 A||OI|2 • 

Proof. Let Ph(5) be a projection defined by 

1 r ,-1 



Ph(S) = —6 (X-H(5))- 1 d\, 
2m J\X\=p 

and let Qh(8) = I — Ph{$)- In view of Proposition^! there exist positive 
numbers po and 5q such that Xq := R{Ph{o~)) is 4-dimensional for every 
<5€(0,5 ). 

Let Xq be a linear subspace whose basis is ($1, $ 2 , $3, $4). We decompose 
H 2 (R;C 2 ) and L 2 (M;C 2 ) as 

# 2 (M;C 2 ) = * eQff(0)iT 2 (R;C 2 ), L 2 (M;C 2 ) = X Q H (0)L 2 (M; C 2 ). 
Then 

H( ^_(Hn(S) H 12 (5)\ 
[ >~ \H 21 (5) H 22 (5))> 

where 

H n (5) = P H (0)H(6)P H (0), H 12 (5) = P H (0)H(S)Q H (0) 
H 21 (5) = Q H (0)H(S)P H (P), H 22 (5) = Q H (0)H(5)Q H (0). 
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By a simple computation, we have 

I l + b 2 5 2 

H n (S) 



-2ia '51 + 



h5 2 












o i + M 2 



b 3 5 2 J 



H 12 (5) = -iaf5 2 P H (0)a 1 Q H (0), H 21 {5) = -ia^ 2 5 2 Q H ^)a 1 P H ({)), 



where 



bi - a 2 6i\\Q c \\ 2 L 2 {R) , 



-a 2 9i\\d c Q c \\ 2 L2 ^, 



-4a 



„ . 64 = a 2 \\sQ ( llJ 



WQc 



1 

1 



First, we investigate the spectrum of Hu(S). Suppose A is an eigenvalue 
of the matrix Hn(5). Then 

det{XI - H n (5)) 

= {(A + 2ia 2 5f - bid 2 - bib 2 5 A ) {(A + 2ia„ 2 5) 2 - b 3 S 2 - b 3 b A 5 4 } = 0. 
Hence there exist eigenvalues Aj (i = 1,2,3,4) of Hn(5) satisfying 

Ai = -6 (2ia 2 - q S + 0{5 2 )) , \ 2 = -5 {2ia^ 2 + a^i + 0{5 2 )) , 

A 3 = -4iaQ 2 5 (1 + 0(5 2 )) , A 4 = 0(5 3 ). 

Let Ru(\,S) = (A - Hii{5))- 1 for % = 1,2 and let 



R (X,5) 



(Rn(X,5) 
V R 22 (\,5) 



V (X,S) 



i7i 2 (A,5) J R 22 (A,,5) N 
H 21 (X,5)R n (X,5) 

We remark that R 22 (X,5) is uniformly bounded for X £ U and <5 £ (0, 5q). 
Suppose that |A — Aj| = c±8, where c\ G (0, ct^" 1 |7|5/4) is a constant such 
that |Aj — Afc| > c\5 for every j, k = 1, 2, 3, 4 with j 7^ k. Then in view of 
the definitions of Hi 2 (X,S) and H 2 i(X,5), we have 



(54) 
and 

(55) 

Now let 



\\Va(X,S)\\ B(Lm) =0(6), 
00 

(X-HiS))- 1 =R (X,5)Y,Vo(X,5y. 
PhM . (A — H(6))~ 1 dX, 



2m 

p »<<< 4 > =h 



|A-A;|=ci<S 



R (X,5)dX. 



'|A-Ai|=ci5 

Combining and lfB3|) with the fact that 

RnHi 2 R 22 \ 
^R 22 H 2 iRn J 



\\Ro(X,5)Vo(X,5)\\ B(L , m 



B(L 2 (R)) 



0{5), 
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we have 

\PH,i( S ) ~ PhA 5 )\\ = fOT evei T * = 1. 2 > 3 > 4 - 

Hence it follows that R(PH,i(6)) is isomorphic to R(Pji,i(5)) and that 
R(Pjj t i(8)) is 1-dimensional for i = 1,2,3,4. Furthermore, we see that 
eigenvalues of H(5) which lie in U satisfy |A — Aj| < c\5 for an i E N 
with 1 < i < 4. 

Since d||Q c ||^ 2 ^/fic > for p € (1, 5), we see that 7 is a positive number 
and that there exist eigenvalues Ai and A2 satisfying 

ao V/2 < KAi < 3q V/ 2 , -3q V/ 2 < KA 2 < -c*o V/2. 
Thus we complete the proof of Lemma 1131 □ 

Proposition 14. Let j, m 6 N, e = m _1 and 5 = je. Lei /3 = min(p — 
l,l)/6. Then there exists an £ N such that if m > m*, the linearized 
operator H(e, 6) with j = [m^ 3 ] has an unstable eigenvalue. 

Proof. In order to prove Proposition^! we wm show the spectrum of H(e, 6) 
becomes close to the spectrum of H (5) as e { 0. Let 



Ho = i 



2jm a m 2 +j 2 ' 
771 — t-±r ~ u> 771 — 



A r -U) 



m 2 +j 2 — 2jm 



and H = UHoU' 1 . Let 

= (r r -xo)(A - Hoy^Tr-xo) + r f %l(A - H^^x^. 

Then we have 

V(X)U(X - H(e, <5))C/- 1 = I + R 3 + R 4 , 

where 

*-^K»(*-flb)-'{( Wi ^i ^rO-^^'C I 

25 1 25 



R41 - I 1 , *2 l\.2 



28 


l+5 2 -\e 2 
(ao+er) 2 


+ 


1+5 2 


1+5 2 


-25 


+ 


25 


«8 


(ao+er) 2 





42 



(ao+er) 2 a 2 
(ao+er) 2 

/(&,)- /(Qc) 

- /'(Q C ) 

We remark that 

Pr>Xi]b(L 2 (ii),H-i(iR)) = O^ 1 ) for i = 0,l, 
||xi-R4i||b(l 2 (r 2 )) + \\R^2\\b(l 2 (r 2 )) = 0(e 6/3 l). 

We have 

SUP II (A - W )" 1 || B{H -2 (R2)iL 2 (IR 2 )) < OO, 

AsC,| A|<oj/2 

since 

V -A r + u + ^-p- 
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o 



M 1 -h 

Lemma El yields that for 5 £ (0, 5q), there exists a c > such that 



for every X £ U with mini<j<4 |A — A$(<5)| > c5 and that 9i(Ai(<5) — cS) > 0. 
Let I = 5~ 3 . Then it follows from the above that 



\R: 
\R 



3||B(L2(]R2)) 

4||B(i2(]R2)) 



0(5 3 + e- 2 ^ 
0{5 2 + e^5- A ) 



Put 



1 



?K,i(e,<5) 

2? ™ ./|A-Ai(<5)|=c<5 

P/r,i(M) =C/~ 1 r f xiP ff) i(5)xir_ f C/. 



(A - (5)) _1 dA, 



Making use of Cauchy's theorem and noting that 5 
\\Vh,i(,£,$) -Ph,i(M)IIb(l2(r2)) 

{(A - - U^ViXp} dX 



we have 



1 

2^ 



|A|=c<5 



B(L?(R2)) 



<C7> SUp (||-R3||s(L 2 (-f,oo)) + H- R 4||b(L 2 (-F,oo))) 
| A|=c<5 

<C(5 + e 6l3 5- 5 ) 
=0(5). 

From the above, we conclude that the range of Vt-c,x( £ i is isomorphic to 
the range of Ph,i{$) and that there exists an eigenvalue A of H(e,5) with 
5RA > 0. Thus we complete the proof of Proposition 1141 □ 

Now we are in position to prove Theorem^ 

Proof of Theorem^ Let £ be the linearized operator of Q around e ^ ( a;^ +" ^^, )^ 
Then 



A-w + /3i(r) 



- 2im9 f3 2 (r) 



Proposition El tells us that £ has unstable eigenvalues if m E N is large and 
p G (1,5). On the other hand, ^S] tells us that £ has an unstable eigenvalue 
if p > 3. Hence it follows that £ has an unstable eigenvalue if p > 1 and 
m € N is sufficiently large. □ 
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